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[57] ABSTRACT 

A CCD portion is driven by a driving circuit for separately 
reading out all pixels. Data for 4 lines are input in parallel 
to a two-dimensional register array by scanning line delay 
devices, and an interpolation processing is performed for 
each of color signals G, Mg, Cy and Ye based on data 
corresponding to pixels in a 4 row by 4 column matrix. Color 
difference signal generation circuit performs a color sepa- 
ration processing based on thus interpolated color signals. 

11 Claims, 10 Drawing Sheets 
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FIG. 2 A 
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FIG. 13 PRIOR ART 
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COLOR CAMERA HAVING A SINGLE 
IMAGING ELEMENT AND CAPABLE OF 
RESTRICTING UNWANTED FALSE COLOR 
SIGNAL 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to color cameras, 
and more particularly, to a 1-chip color camera having a 
color separation circuit for processing signals from a solid- 
state imaging device where the device includes photoelectric 
conversion elements arranged in an array corresponding to 
color filters themselves being arranged in an array according 
to the color difference sequential system. 

2. Description of the Background Art 

A CCD (Charge Coupled Device) widely today as an 
imaging device in a color camera simply changes the 
amplitude of a signal to output depending upon the bright- 
ness of received light and does not include any color 
information in its output signal. Some device is necessary 
such as using optical means to filter light coming into the 
CCD in order to obtain color information. 

In a color camera for home use, a so-called 1-chip image 
pickup system to extract three primary color signals from a 
single CCD is employed and a so-called simultaneous color 
imaging system using a color filter array on the light 
receiving side of the CCD is also employed. 

STRUCTURE OF INTERLINE TRANSFER CCD 

FIG. 10 is a block diagram schematically showing the 
configuration of an interline transfer CCD portion 10 as an 
example of CCD generally used in a home use color camera. 

Interline transfer CCD portion 10 includes a photosensi- 
tive portion 12 of pn junction type photodiodes arranged in 
an array, a transfer portion 14 including analog shift registers 
formed of CCDS, and a horizontal transfer register 16 which 
receives charges transferred by transfer portion. 14 and 
transfers signals produced by converting a sequentially 
transferred signal charges into voltages for output. 

In FIG. 10, pn junction type photodiodes for three pixels 
are provided in each of the vertical and horizontal directions 
for ease of illustration. In practice, in a CCD for use in a 
color camera, photodiodes corresponding to 500 pixels in 
the vertical direction and to 500 to 800 pixels in the 
horizontal direction are arranged in an array. 

The operation of the CCD portion will be now briefly 
described. 

When light comes into the photodiodes, charges are 
generated and accumulated within the diodes. Then, the 
accumulated charges are transferred to analog shift register 
14 at a time by applying a prescribed voltage to the shift 
gate. CCD analog shift register 14 transfers the charges 
toward sequential horizontal transfer register 16 in response 
to application of clock pulse voltages (j)^, and (j^. 
Horizontal transfer register 16 converts thus transferred 
signal charges into voltages and then is driven by externally 
applied horizontal driving signals ^ mt ^ and ^ m to 
externally output the voltages as sequential imaging signal 
outputs. 

DRIVING METHOD OF INTERLINE 
TRANSFER CCD 

There are generally two modes for driving the interline 
transfer CCD portion, in other words modes according to the 



frame integration method and the field integration method. 
In a color camera, the frame integration method, in which all 
pixels are basically read out, is sometimes used for a color 
filter array in the color difference sequential system. 
5 Hereinafter, the operation of the interline transfer CCD 
portion in a frame integration mode which permits reading 
on a one -pixel-basis will be considered. 

METHOD OF SEPARATING COLOR 
30 DIFFERENCE SIGNALS 

FIG. 11 is a diagram schematically showing an array of 
color filters arranged according to the color difference 
sequential system. 

35 As shown in FIG. 11, the color filters according to the 
color difference sequential system, color filters for magenta 
(hereinafter simply as Mg), green (G), cyan (Cy), and yellow 
(Ye) are arranged in a mosaic form. 

Herein, in mixing optical colors, a so-called additive 

20 mixing is possible, and therefore the following relation is 
established between three primary colors, red (R), green (G), 
and blue (B) and their complementary colors, Mg, Ye, and 
Cy: 



25 



30 



Cy-B+G 



(1) 
(2) 
(3) 



Using the above Mg, G, Ye and Cy as the colors of color 
filters, the intensity of the G signal having the largest weight 
relative to the luminance signal among the three primary 
colors R, G and B may be set larger than that of the R signal 
or B signal. 

35 In the example shown in FIG. 11, among a color filter 
array according to the color difference sequential system, an 
array portion of a 4 row by 4 column matrix is extracted 
from the color filter array according to the color difference 
sequential system. In the odd rows (x-1, 3), G color filters 

40 and Mg color filters are alternately arranged in the horizontal 
direction (y-direction). 

Meanwhile, in the even rows (x=0, 2), Ye color filters and 
Cy color filters are alternately arranged in the horizontal 
direction. 

45 FIG. 12 shows an arrangement of color filters in a 4 row 
by 4 column matrix, shifted by 1 pixel in the horizontal 
direction from the arrangement shown in FIG. 11. 

If outputs from photoelectric conversion elements are 
sequentially read out in the y-direction, for example, outputs 
50 from photoelectric conversion elements for a 4 row by 4 
column matrix read out from the CCD portion repeatedly 
alternately correspond to outputs from the color filter array 
shown in FIG. 11 and to outputs from the color filter array 
shown in FIG. 12, In the arrangement of the color filters 
55 according to the color difference sequential system as shown 
in FIG. 11, the arrangement of color filters in an arbitrary 4 
row by 4 column matrix is any of four arrangements 
including those shown in FIGS. 11 and 12 and arrangements 
1 pixel shifted in the x-direction from the arrangements 
60 shown in FIGS. 11 and 12. 

FIG. 13 is a diagram showing the concept of a conven- 
tional color separation method. In FIG. 13, a 2 row by 2 
column matrix is extracted from the arrangement of the 4 
row by 4 column matrix shown in FIG. 11. In the conven- 
es tional color separation method, a luminance signal Y, a first 
color difference signal Cb and a second color difference 
signal Cr are generated for the central position of pixels in 
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the 2 row by 2 column matrix from signals corresponding to 
the pixels in the 2 row by 2 column matrix among signals 
obtained by reading out all the pixels in the CCD portion. 

Herein, luminance signal Y, first color difference signal 
Cb, and second color difference signal Cr may be repre- 
sented by the following expressions, wherein R, G and B 
represent signal intensities corresponding to the three pri- 
mary colors: 



K= (Cy+ Mg) + (Ye + G) 
= {R + G + 2B) + (R + 2G) 
= 2R+3G + 2B 

Cb = (Cy + Mg) - {Ye + G) 
= (R+G+2B)-(R + 2G) 
-2B-G 

Cr = (Ye + Mg) -(G + Cy) 
= (2R + G + B) - (B + 1G) 
= 2R-G 



(4) 10 



(5) 



(6) 



Therefore, only if signals from the photoelectric conver- 
sion elements in the 2 row by 2 column matrix shown in 
FIG. 13 are available, luminance signal Y, first color differ- 
ence signal Cb, and second color difference signal Cr may 
be basically obtained, based on which three primary color 
signals may be separated according to the following opera- 
tions: 



G~(2Y-2Cr-2Cb)nQ 

R-(Y+4Cr-Cb)nQ 

B~(Y-Cr+4Cb)nQ 



25 



(7) 30 
(8) 



(9) 



35 



The above-described color separation method is however 
encountered with the following problems. 

FIG. 14 is a graph showing the frequency characteristics 
of output signals Ye+G, Cy+Mg, G+Cy and Ye+Mg in the 
horizontal direction when the conventional color separation 
method as shown in FIG. 13 is implemented using digital 
filters. 

In FIG. 13, assuming that signals from the CCD portion 
are read out sequentially in the y-direction, signals Ye+G 
and Cy+Mg are generated from signals sampled at the same 
time point, while, for signals G+Cy and Ye+Mg, signals 
from the CCD portion should be held for 1 sampling time 
period. 

Therefore, the gains of signals Ye+G and Cy+Mg do not 
have frequency dependence, while signals G+Cy and 
Ye+Mg have their gains monotonically decreased toward the 
Nyquist frequency. 

If the frequency characteristics of signals in the horizontal 
direction, based on which the first and second color differ- 
ence signals Cb and Cr are generated, are different, an 
unwanted false color signal is generated, which leads to a 
deterioration in the picture quality. 

SUMMARY OF THE INVENTION 



It is an object of the invention to provide a 1-chip color $0 
camera capable of controlling color component signals to 
have similar band characteristics and restricting unwanted 
false color signals, thereby improving the picture quality. 

Another object of the invention is to provide a 1-chip 
color camera capable of restricting a deterioration in the 65 
resolution if color signal components are controlled to be in 
the same band. 



55 



Briefly stated, a 1-chip digital color camera according to 
the present invention includes a solid-state imaging element 
and a color separation circuit. 

The solid-state imaging element includes photoelectric 
conversion elements corresponding to pixels arranged in an 
array. The solid-state imaging element includes, on the light 
receiving side, a color filter array in which green filters and 
first to third complementary color filters are arranged in a 
mosaic corresponding to the photoelectric conversion ele- 
ments according to the color difference sequential system. 

The color separation circuit receives the output of the 
solid-state imaging element and produces color data corre- 
sponding to the central position of pixels in an arbitrary k 
row by k column matrix (k:even number). The color sepa- 
ration circuit includes color interpolation circuits for green 
and the first to third complimentary colors for producing the 
weighted average of outputs from photoelectric conversion 
elements, at which corresponding color filters are provided, 
among the plurality of photoelectric conversion elements 
corresponding to the pixels in the k row by k column matrix 
based on the arrangement of the color filters and a first 
operation circuit for separating color data corresponding to 
the central position from outputs received from the color 
interpolation circuits. 

Therefore it is a main advantage of the present invention 
that an interpolation processing is performed before a color 
separation processing, and color components are controlled 
to be in the same band, so the bands of signals Ye+G and 
Cy+Mg and signals G+Cy and Ye+Mg are very close to each 
other up to the vicinity of Vi the Nyquist frequency, and 
therefore unwanted false color signals in the vicinity of M 
the Nyquist frequency may be readily reduced. 

Another advantage of the invention is that in generating 
an aperture signal, a deterioration in the resolution caused by 
interpolation processing can be restricted. 

The foregoing and other objects, features, aspects and 
advantages of the present invention will become more 
apparent from the following detailed description of the 
present invention when taken in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic block diagram of the configuration 
of a color signal processing system 1000 according to the 
invention; 

FIGS. 2A to 2E are schematic diagrams for use in 
illustration of an interpolation processing according to the 
invention, wherein FIG. 2A shows a color filter array 
arrangement according to the color difference sequential 
system, and FIGS. 2B to 2E show arrangements of weight- 
ing coefficients used at the time of interpolating processings 
to color signal components; 

FIG. 3 is a block diagram showing the configuration of 
two-dimensional register array 30 in color signal processing 
system 1000 shown in FIG. 1; 

FIG. 4 is a block diagram showing the configuration of 
interpolation processing circuit 34 in color signal processing 
system 1000 shown in FIG. 1; 

FIG. 5 is a graph showing the frequency characteristics of 
color signals according to the invention; . 

FIG. 6 is a block diagram showing the configuration of 
color separation circuit 36 in color signal processing system 
1000 shown in FIG. 1; 

FIG. 7 is a first schematic diagram for use in illustration 
of the procedure of generating an aperture signal; 
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FIG. 8 is a second schematic diagram for use in illustra- a 4 row by 4 column matrix (including green, yellow, cyan 

tion of the procedure of generating an aperture signal; and magenta color signals corresponding to an arrangement 

FIG. 9 is a block diagram showing the configuration of of color filters in ^ CCD portion from which the signals 

luminance signal generation circuit 32 and aperture signal have been read out at that point), an interpolation processing 

generation circuit 38 in color signal processing system 1000 5 circuil 34 wnich receives signals from two-dimensional 

shown in FIG. 1; register array 30 and produces the weighted average of color 

FIG. 10 is a schematic block diagram showing the con- si 8" als of e f ch of 8 reen > y ell ° w > c y an L and ma 6 ema . 10 

ventional configuration of a CCD portion 10; P™ d " ce aco ° r ?'8 nal corresponding to the central pos.tion 

_ . t , „ , , of the pixels m the 4 row by 4 column matrix by 

FIG. 11 is a schematic diagram showing an example of an 1Q ^xpoUtkm, a color differe a C e signal generation circuit 36 

arrangement of color filters in a 4 row by 4 column matrix for ati ^ difference signais cb and Cr from the 

m a conventional arrangement of color filters according to color si ls ated 5 thc interpolation, a luminance 

the color difference sequential system; signa] generatkm circuit 32 which receives a signal from 

FIG. 12 is a schematic diagram showing another example two-dimensional register array 30 and generates a luminance 

of a conventional arrangement of color filters in a 4 row by 15 s j gna ] y, and an aperture signal generation circuit 38 which 

4 column matrix in the arrangement of color filters accord- receives luminance signal Y and (though, for simplicity, not 

ing to the color difference sequential system; specifically shown in this figure) a signal from two- 

FIG. 13 is a diagram showing the concept of a conven- dimensional register array 30 and outputs an aperture signal 

tional color separation method; and AP. 

FIG. 14 is a diagram showing the frequency characteris- 20 Herein, imaging lenses included in optical system 2 are 

tics of output signals according to the conventional separa- generally provided with variable mechanisms for a dia- 

tion method. phragm function, focusing, zooming and the like. 

Color signal processing system 1000 further includes an 
aperture correction circuit 39 for correcting an aperture 
(emphasizing a contour) in response to an aperture signal. 

FIG. 1 is a schematic block diagram showing the con- In the above-described structure, the first to fourth, four 

figuration of a color signal processing system 1000 includ- kinds of input signals correspond to imaging signals for four 

ing stages from an optical system 2, forming an optical scanning line (four lines) and are input to color separation 

image of an object to image at an imaging element, CCD ^ circuit 100 on a 4-line -basis. 

portion 10 to a color separation circuit 100 in the configu- color separa tion circuit 100 and the three scanning 

ration of a 1-chip color camera according to an embodiment de lay devices 18 to 22 implement an FIR (Finite 

of the invention. Impulse Response) filter. 

Color signal processing system 1000 includes an optical 

system 2 which receives light from an object, a CCD portion 35 Interpolation and Color Separation 

10 which converts an optical image formed by optical . FIGS 2A {Q 2R afe schematic diagrams for use in 

system 2 into an electncal signal, a driving circuit 40 which in ustrat i on of an interpolation processing according to the 

drives CCD portion 10 to separately read out all pixels, a embodiment of the invention, wherein FIG. 2A shows an 

correlated double sampling circuit (hereinafter referred to as example of an arrangement of a color filter array in a 4 row 

CDS circuit) 44 for removing noise from an imaging signal 40 by 4 column matrix ^ nG 2 B shows a distribution of 

received from CCD portion 10 according to a well known we i g hting coefficients at the time of interpolation processing 

method, an auto gain control signal circuit (hereinafter AGC for the arrange ment of magenta color filters in FIG. 2A, FIG. 

circuit) 46 for amplifying the output of CDS circuit 44, an 2C shows a distribution of weighting coefficients at the time 

A/D conversion circuit 48 for converting the output of AGC of interpolation process i ng for the arrangement of green 

circuit 46 into a digital signal, a frame memory 50 for 45 filters in FIG. 2A, FIG, 2D shows a distribution of weighting 

holding output signals for even lines and output signals for coefficie nts at the time of interpolation processing for the 

odd lines, in CCD portion 10, received from A/D conversion arrangemen t of cyan color filters in FIG. 2A, and FIG. 2E 

circuit 48 for 1 image frame in a nested manner, and a shows a distribution of weighting coefficients at the time of 

control circuit 42 which outputs a horizontal address HA and interpolation processing for the arrangement of yellow filters 

a vertical address VAfor a pixel from which a signal is read 50 in FIG 2 A 

out in response to a CCD driving signal from driving circuit w .„ „ . . . t „ - . t . 

4 q More specifically, in this embodiment, by an interpolation 

* , . r . -it processing according to the following weighted average 

Color s lg nal processing system 1000 further includes a ocessin for the weights showD ^ nGSt 2B -2E applied to 

scanning line delay device 18 which outputs a second input me ixels snown in nG 2A> a m &{ x QQm 

signal produced by delaying a first input signal from frame 55 a grecn signal component, a cyan signal component and a 

memory 50 by 1 scanning line time period and a third input 1]ow si j ^ t correspond i n g l0 lhe p0 si- 

signal produced by delaying the second input signal by 1 ^ ^ in the 4 row b 4 column matrix arc 

scanning line time period, a scanning line delay device 22 generated 
which outputs a fourth input signal produced by delaying the 

third input signal by 1 scanning line time period, and a color 60 Mg-2xMgli+Mgi$+Mg3i (10) 
separation circuit 100 serving as a two-dimensional non- 
recursive digital filter which receives first to fourth input 

signals and outputs luminance signal Y, first color difference Cy=2xCy2i+cyoi-t-cy23 (12) 
signal Cb and second color difference signal Cr. 

Color separation circuit 100 includes a two-dimensional 65 

register array 30 which sequentially receives the first to Note that, as described in conjunction with FIGS. 11 and 

fourth input signals in parallel and holds data from pixels in 12, there are four kinds of arrangements of color filters 



G-2xG12+C10+G32 (11) 
Cy=2xCy2 1 +C>0 1 -t-Cy23 (1 2) 

Kc-2xye22+r«02+re20 (13) 
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corresponding to pixels in a 4 row by 4 column matrix, and signal d21 for output, an adder 3424 for outputting the result 
other than the case of the arrangement shown in FIG. 2A, the of adding signal dlO and signal d32, and an adder 3426 for 
distributions of weighting coefficients for weighted average outputting the result of adding the amplitudes of outputs 
processing to color filters correspond to the other distribu- from adder 3424 and multiplier 3422 as the first interpola- 
tions in FIGS. 2B to 2E, respectively. 5 tion signal. Interpolation operation portions 344, 346 and 
As described above, according to this embodiment, CCD 348 have basically the same configuration as interpolation 
portion 10 performs an all pixel-separate ly read out opera- operation portion 342, however they receive different sig- 
tion. More specifically, corresponding to an arrangement in nals. 

which color filters Ye and Cy are alternately arranged in the Therefore, when color filters are arranged as shown in 

horizontal direction (y-direction) in the 0-th line in the 10 FIG. 2 A, interpolation operation portions 342, 344, 346 and 

vertical direction (x-direction) as shown in FIG. 2 A, Ye and 348 correspond to weighted average processings based on 

Cy are alternately output as read out signals from CCD the arrangements of weighting coefficients shown in FIGS, 

portion 10 for a scanning line corresponding to the line. In 2C, 2B, 2D and 2E, respectively. 

the next 1st line (corresponding to x=l), signals G and Mg Selecting circuit 350 responds to the least significant bit 

are alternately output. is h-addLSB of horizontal address HA and the least significant 

FIG. 3 is a block diagram showing in further detail the bit v-addLSB of vertical address VA representing the present 

configurations of scanning line delay devices 18, 20 and 22 reading position in CCD portion 10 output from control 

and two-dimensional register array 30 which receive a read circuit 42 to switch the correspondence between the first to 

out signal from such CCD portion 10 in the configuration fourth interpolation signals and green signal G, cyan signal 

shown in FIG. 1. 20 Cy, magenta signal Mg and yellow signal Ye for output. 

Two-dimensional register array 30 includes a register 302 If color filters are arranged as shown in FIG, 2 A, for 

which receives an output from frame memory 50 holding an example, selecting circuit 350 outputs signals such that the 

output signal from A/D converter 16 and outputs a 1 clock first interpolation signal corresponds to green signal G, the 

delayed signal dOl, and a register 304 which outputs a signal second interpolation to magenta signal Mg, the third inter- 

d02 1 clock delayed from received signal dOl. 25 polation signal to cyan signal Cy and the fourth interpolation 

Two-dimensional register array 30 further includes a signal to yellow signal Ye. 
register 306 which outputs a signal dll 1 clock delayed from If the arrangement of color filters corresponding to pixels 
signal dlO received from scanning line delay device 18, a in a 4 row by 4 column matrix from which signals are read 
register 308 which outputs a signal dl2 1 clock delayed from out changes, selecting circuit 350 changes the above- 
received signal dll, a register 310 which outputs a signal 30 described corresponding relation accordingly. 
dl3 1 clock delayed from received signal dl2, a register 312 By the above-described operation of interpolation pro- 
which outputs a signal d21 1 clock delayed from.a signal d20 cessing circuit 34, for each of green signal G, cyan signal Cy, 
received from scanning line delay device 20, a register 314 magenta signal Mg and yellow signal Ye, a signal corre- 
which outputs a signal d22 1 clock delayed from received sponding to the central position of pixels in 4 rowx4 column 
signal d21, a register 316 which outputs a signal d23 1 clock 35 matrix is generated by prescribed weighted average process- 
delayed from received signal d22, a register 318 which ings to signals read out from photoelectric conversion ele- 
outputs a signal d31 1 clock delayed from a signal received ments corresponding to the pixels in the 4 row by 4 column 
from scanning line delay device 22, and a register 320 which matrix. 

outputs a signal d32 1 clock delayed from received signal FIG. 5 is a graph showing the frequency characteristics of 

d31. 40 output signals Ye+G, Cy+Mg, G+Cy and Ye+Xg when 

More specifically, two-dimensional register array 30 con- interpolation processings are implemented using a digital 

verts signals serially read out from CCD portion 10 such that filter as shown in FIG. 3, in contrast to FIG. 14. 

signals from photoelectric conversion elements correspond- The frequency characteristics of output signals Ye+G, 

ing to pixels in a 4 row by 4 column matrix are output in Cy+Mg, G+Cy and Ye+Mg are virtually the same up to the 

parallel. 45 vicinity of the Vi Nyquist frequency as a result of interpo- 

More specifically, signals dOl to d32 described above lation processing. Therefore, if color difference signals Cb 

correspond to expressing output signals from photoelectric and Or are obtained by a color separation processing based 

conversion elements corresponding to pixels (x, y) in CCD on these signals, unwanted false color signals can be 

portion 10 using symbols d, x and y. restricted, which leads to improvement in the picture quality. 

FIG. 4 is a block diagram showing in further detail the 50 Note that in the foregoing, the interpolation processings s 

configuration of interpolation processing circuit 34 in FIG. by the weighted average processing of the arrangements of 

1. weighting coefficients shown in FIGS. 2B to 2E are per- 

Interpolation processing circuit 34 includes an interpola- formed to output signals from photoelectric conversion 

tion operation portion 342 which receives signals dl2, dlO elements corresponding to pixels in a 4 rowx4 column 

and d32 and outputs a first interpolation signal, an interpo- 55 matrix, but the invention is not limited to such a case. For 

lation operation portion 344 which receives signals dll, d 13 example, pixels to be subjected to such an interpolation 

and d31 and outputs a second interpolation signal, an processing may be pixels in a k row by k column matrix if 

interpolation operation portion 346 which receives signals k is an even number. 

d21, dOl and d23 and outputs a third interpolation signal, an Four sets of weighting coefficients of the weighted 

interpolation operation portion 348 which receives signals 60 average, each corresponding to one of four color signals, in 

d22, d02 and d20 and outputs a fourth interpolation signal, other words, green signal, cyan signal, magenta signal and 

and a selecting circuit 350 controlled by a control circuit 42 yellow signal, need only be arranged in such a way that the 

to output the first to fourth interpolation signals as green arrangement of one of the four sets corresponds to one of the 

signal G, cyan signal Cy, magenta signal Mg and yellow arrangements of the rest at every 90° rotation around the 

signal Ye, respectively. 65 central position. 

Herein, interpolation operation portion 342 includes a Furthermore, the color signals are not necessarily limited 

multiplier 3422 which doubles the amplitude of received to the green signal, cyan signal, magenta signal and yellow 
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Cb=(Cy + Mg)-(.Ye+G) 
= (R + G + 2B)-(R + 2G) 
= 2U-G 

Cr={Ye + Mg)-{G+Cy) 
o (2R + G+ B)-(B + 2G) 
= 2R-G 



(14) 



(15) 



Generating Luminance Signal and Aperture Signal 



Y = (Cy + Mg) + (Ye + G) 
= (/?■*- G +■ 2B) + {R 4- 2C) 
= 2R + 3C +• 2 



(16) 



10 



10 



signal, and the invention is applicable to combinations of 
other color signals such as a combination of YM, CG, YG 
and CM used for color filters according to the frame color 
difference sequential system. 

FIG. 6 is a block diagram showing in further detail the 
configuration of color difference signal generation circuit 36 
shown in FIG. 1. 

Referring to FIG. 6, color difference signal generation 
circuit 36 includes an adder 362 which adds received yellow 
signal Ye and magenta signal Mg, an adder 368 which adds 
the amplitudes of received green signal G and cyan signal 
Cy, a multiplier 374 which multiplies the output of adder 
368 by -1, and an adder 376 which adds the output of adder 
362 and the output of multiplier 374 to output a signal Cr. 

Color difference signal generation circuit 36 further 35 
includes an adder 364 which adds received magenta signal 
Mg and cyan signal Cy, an adder 366 which adds the 
amplitudes of received green signal G and yellow signal Ye, 
a multiplier 372 which multiplies the output of adder 366 by 
-1, and an adder 370 which adds the output of adder 364 and 20 
the output of multiplier 372 to output a signal Cb. 

More specifically, color difference signal separation cir- 
cuit 36 generates color difference signals Cb and Cr from 
green signal G, cyan signal Cy, magenta signal Mg and 
yellow signal Ye by the following operation processings: 



a resolution as high as possible, and use of a signal after an 
interpolation processing also causes a deterioration in the 
.resolution. 

FIG. 7 is a first schematic diagram for use in illustration 
of the procedure of generating luminance signal Y as 
described above and an aperture signal AP. FIG. 8 is a 
second schematic diagram showing the procedure of gener- 
ating aperture signal AP. 

Referring to FIG. 7, signals Y01, Y10, Yll, Y12 and Y21 
are generated by the following operations: 



25 



35 



Herein, the luminance signal may be generated by the 
following operation with green signal G, cyan signal Cy, 
magenta signal Mg and yellow signal Ye obtained by the 40 
above-described interpolation processing. 



45 



50 



55 



The luminance signal may be generated by an operation 
based on the above expression directly from signals corre- 
sponding to pixels in a 2 rowx2 column matrix surrounding 
the central position among signals from photoelectric con- 
version elements corresponding to the pixels in a 4 rowx4 
column matrix. More specifically, in this case, luminance 
signal Y is generated according to the same method as the 
conventional color separation method described in conjunc- 
tion with FIG. 13. 

Unwanted false color signals may be restricted by the 
interpolation processing, but the resolution may deteriorate 
because of the interpolation. Human eyes are more sensitive 60 
to luminance information than color information, and there- 
fore luminance signal Y obtained without the interpolation 
processing may be directly used in order to restrict a 
deterioration in the resolution sensed by human eyes. 

This is also true to generation of an aperture signal for 
aperture correction. More specifically, a luminance signal 
used as a base for generating an aperture signal desirably has 



65 



I'D 1 -Ye02+Cy 0 1 +Afgll +GH 2 
nO=re20+C>>21+JVfgll+G10 
nUYelZ+CylUMgU+Gtl 
Yl2-Ye21+Cyl3+MgU+GlZ 
Yl\=Ye2l+Cyl\ +Afg31+C32 



(17) 
(18) 
(19) 
(20) 
(21) 



More specifically, Yll corresponds to luminance signal Y. 
Signals Y01, Y10, Y12 and Y21 are generated from signals 
from photoelectric conversion elements corresponding to 
pixels in a 2 row by 2 column matrix including two of the 
pixels in the 2 rowx2 column matrix in the center used to 
generate Yll. 

Now, referring to FIG. 8, aperture signal AP is generated 
by the following operation based on thus generated signals 
Y01, Y10, Yll, Y12 and Y21. 



AP=4xyii-voi-no-n2-y2i 



(22) 



FIG. 9 is a schematic diagram showing in more detail the 
configuration of luminance signal generation circuit 32 and 
aperture signal generation circuit 38 shown in FIG. 1. 

Luminance signal generation circuit 32 includes an adder 
322 which adds the amplitudes of received signals dll and 
d21, an adder 324 which adds the amplitudes of received 
signals dl2 and d22, and an adder 326 which adds the 
amplitudes of outputs received from adders 322 and 324 to 
output luminance signal Y (Yll). 

Aperture signal generation circuit 38 includes an adder 
382 which adds received signals dOl and dll, an adder 386 
which adds received signals d02 and dl2, an adder 384 
which adds outputs received from adders 382 and 386, an 
adder 388 which adds received signals dlO and d20, an 
adder 392 which adds outputs received from adder 388 and 
adder 322 in luminance signal generation circuit 32, and an 
adder 390 which adds the outputs of adders 384 and 392. 

Aperture signal generation circuit 38 further includes an 
adder 398 which adds received signals d21 and d31, an 
adder 402 which adds received signals d22 and d32, an 
adder 400 which adds outputs received from adders 398 and 
402, an adder 396 which adds received signals dl3 and d23, 
an adder 394 which adds outputs received from adder 396 
and adder 324 in luminance signal generation circuit 32, an 
adder 404 which adds the outputs of adders 394 and 400, an 
adder 406 which adds the outputs of adders 390 and 404, a 
multiplier 410 which multiplies the output of adder 406 by 
-1, a multiplier 408 which multiplies luminance signal Y by 
4, and an adder 412 which adds outputs received from 
multipliers 408 and 410 to output signal AP. 

More specifically, luminance signal generation circuit 32 
outputs luminance signal Y based on an operation repre- 
sented by expression (19), while aperture signal generation 
circuit 38 generates aperture signal AP by operations based 
on expressions (17) to (21) for output. 

In the foregoing structure, when aperture signal AP is 
generated, luminance signal Y based on signals from pho- 
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toelectric conversion elements corresponding to pixels in a 
2 row by 2 column matrix surrounding the central position 
in a 4 row by 4 column matrix is used, and therefore a 
deterioration in the resolution caused by interpolation pro- 
cessing may be restricted. 

Although the present invention has been described and 
illustrated in detail, it is clearly understood that the same is 
by way of illustration and example only and is not to be 
taken by way of limitation, the spirit and scope of the present 
invention being limited only by the terms of the appended 
claims. 

What is claimed is; 

1. A 1-chip digital color camera comprising: 
solid-state imaging means having: 

an array of photoelectric conversion elements, each of 
the elements corresponding to a pixel in a plurality of 
pixels; and 

a color filter array in which a green filter and first to 
"third complementary color filters are arranged, cor- 
responding to said photoelectric conversion 
elements, in a mosaic arrangement in a k-row by 
k-column matrix (where k is an even number) with 
ones of the color filters being associated with outputs 
of corresponding ones of the photoelectric conver- 
sion elements; and 
color separation means, responsive to said solid-state 
imaging means, for generating color data correspond- 
ing to a central position in the k-row by k-column 
matrix, wherein said color separation means comprises: 
color interpolation means for producing weighted aver- 
ages of outputs from ones of the photoelectric con- 
version elements so as to generate each of green and 
first to third complementary color signals, wherein 
the color interpolation means forms said weighted 
averages using four sets of matrix- arranged weight- 
ing coefficients, each of the sets associated with a 
corresponding one of said green and said first to third 
complementary color signals, such that a matrix 
arrangement of the weighting coefficients in one of 
the sets corresponds to the matrix arrangement of the 
weighting coefficients in any other one of the sets 
rotated through a corresponding number of 90 degree 
increments about the central position in the matrix; 
and 

first operation means, responsive to said color interpo- 
lation means, for separating, from said weighted 
averages, the color data corresponding to the central 
position. 

2. The 1-chip digital color camera as recited in claim 1, 
wherein 

said color filter array includes a plurality of first rows and 
a plurality of second rows alternately arranged, 

each said first row includes green filters and first comple- 
mentary color filters alternately arranged, and 

each said second row has second complementary color 
filters and third complementary color filters alternately 
arranged. 

3. The 1-chip digital color camera as recited in claim 1, 
wherein said color separation means further comprises: 

conversion means for converting received signals serially 
output for each row in the array of said photoelectric 
conversion elements into parallel signals for each of 
said k rows; and 

first holding means, responsive to the output of said 
conversion means, for holding signals for a k row by 
k-column matrix; 
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wherein said color interpolation means performs 
weighted average processing based on the signals held 
by said holding means. 

4. The 1-chip digital color camera as recited in claim 3, 
further comprising second holding means, responsive to the 
output of said solid-state imaging means, for holding output 
signals from even rows and odd rows in the array of said 
photoelectric conversion elements for 1 image frame so as to 
define held signals, and applying said held signals to said 
conversion means. 

5. The 1-chip digital color camera as recited in claim 1, 
wherein 

said even number k is 4. 

6. The 1-chip digital color camera as recited in claim 5, 
wherein 

said color separation means includes second operation 
means for adding outputs from said photoelectric con- 
version elements in the 2 row by 2 column matrix 
surrounding said central position among outputs from 
said photoelectric conversion elements corresponding 
to the pixels in said 4 row by 4 column matrix to output 
a luminance signal. 

7. The 1-chip digital color camera as recited in claim 6, 
further comprising aperture signal generation means for 
generating and outputting an aperture signal based on a first 
signal which is the sum of D (0, 1), D (0, 2), D (1, 1) and 
D (1, 2), a second signal which is the sum of D (1, 0), D (1, 
1), D (2, 0) and D (2, 1), a third signal which is the sum of 
D (2, 1), D (2, 2), D (3, 1) and D (3, 2), a fourth signal which 
is the sum of D (1, 2), D (1, 3), D (2, 2) and D (2, 3), and 
said luminance signal among the outputs from said photo- 
electric conversion elements corresponding to the pixels in 
said 4 row by 4 column matrix, when the outputs from the 
photoelectric conversion elements corresponding to the pix- 
els in said 4 row by 4 column matrix are D (x, y) (x-0 to 3, 
y^0 to 3), and 

correction means responsive to said aperture signal for 
performing aperture correction. 

8. The 1-chip digital color camera as recited in claim 5, 
wherein 

said color separation means further includes, 
conversion means for converting received signals serially 
output for each row in the array of said photoelectric 
conversion elements into parallel signals for each said 
k rows, and 

first holding means for holding the output of said con- 
version means for holding signals in a 4 row by 4 
column matrix so as to define held signals, and 

said color interpolation means performs a weighted aver- 
age processing based on the signals held by said 
holding means. 

9. The 1-chip digital color camera as recited in claim 8, 
further comprising second holding means, responsive to the 
output of said solid-state imaging means, for holding output 
signals from even rows and odd rows in the array of said 
photoelectric conversion elements for 1 image frame and 
applying said held signals to said conversion means. 

10. The 1-chip digital color camera as recited in claim 5, 
wherein 

when said first to third complementary colors are 
magenta, yellow and cyan, respectively 
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the outputs from the photoelectric conversion elements 
corresponding to the pixels in said 4 row by 4 column 
matrix are D (x, y) (x<*0 to 3, y=0 to 3), and a weighting 
coefficient corresponding to said D (x, y) is w (x, y), 

said interpolation average selectively performs one of a 
first weighted average processing, wherein w (1, 2)=2, 
w=(l, 0)=1 and w (3, 2)«1, 

a second weighted average processing wherein w (1, 
l)-2> w=(3, 1)=1 and w (1, 3)-l, 

a third weighted average processing, wherein w (2, 1)=2, 
w=(2, 3)=1 and w (0, and 

a fourth weighted average processing, wherein w (2, 2)=2, 
w-(0, 2)-l, w (2, 0)-l, depending upon the arrange- 



ment of color filters corresponding to the pixels in said 
4 rowx4 column matrix. 
11. The 1-chip digital color camera as recited in claim 10, 
wherein 

said color separation means includes second operation 
means for adding outputs from said photoelectric con- 
version elements ur the 2 row by 2 column matrix 
surrounding said central position among outputs from 
said photoelectric conversion elements corresponding 
to the pixels in said 4 row by 4 column matrix to output 
a luminance signal. 
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